Electronic immunization data collection systems: application of an evaluation framework

BACKGROUND: Evaluating the features and performance of health information systems can serve to strengthen the systems themselves as well as to guide other organizations in the process of designing and implementing surveillance tools. We adapted an evaluation framework in order to assess electronic immunization data collection systems, and applied it in two Ontario public health units. METHODS: The Centers for Disease Control and Prevention’s Guidelines for Evaluating Public Health Surveillance Systems are broad in nature and serve as an organizational tool to guide the development of comprehensive evaluation materials. Based on these Guidelines, and informed by other evaluation resources and input from stakeholders in the public health community, we applied an evaluation framework to two examples of immunization data collection and examined several system attributes: simplicity, flexibility, data quality, timeliness, and acceptability. Data collection approaches included key informant interviews, logic and completeness assessments, client surveys, and on-site observations. RESULTS: Both evaluated systems allow high-quality immunization data to be collected, analyzed, and applied in a rapid fashion. However, neither system is currently able to link to other providers’ immunization data or provincial data sources, limiting the comprehensiveness of coverage assessments. We recommended that both organizations explore possibilities for external data linkage and collaborate with other jurisdictions to promote a provincial immunization repository or data sharing platform. CONCLUSIONS: Electronic systems such as the ones described in this paper allow immunization data to be collected, analyzed, and applied in a rapid fashion, and represent the infostructure required to establish a population-based immunization registry, critical for comprehensively assessing vaccine coverage

A cost comparison of electronic and hybrid data collection systems in Ontario during pandemic and seasonal influenza vaccination campaigns

<p>Abstract</p> <p>Background</p> <p>During the pandemic (H1N1) 2009 influenza vaccination campaign, health regions in Canada collected client-level immunization data using fully electronic or hybrid systems, with the latter comprising both electronic and paper-based elements. The objective of our evaluation was to compare projected five-year costs associated with implementing these systems in Ontario public health units (PHUs) during pandemic and seasonal influenza vaccination campaigns.</p> <p>Methods</p> <p>Six PHUs provided equipment and staffing costs during the pandemic (H1N1) 2009 influenza vaccination campaign and staffing algorithms for seasonal campaigns. We standardized resources to population sizes 100,000, 500,000 and 1,000,000, assuming equipment lifetime of five years and public health vaccine administration rates of 18% and 2.5% for H1N1 and seasonal campaigns, respectively. Two scenarios were considered: Year 1 pandemic and Year 1 seasonal campaigns, each followed by four regular influenza seasons. Costs were discounted at 5%.</p> <p>Results</p> <p>Assuming a Year 1 pandemic, the five-year costs per capita for the electronic system decrease as PHU population size increases, becoming increasingly less costly than hybrid systems ($4.33 vs.$4.34 [100,000], $4.17 vs.$4.34 [500,000], $4.12 vs.$4.34 [1,000, 000]). The same trend is observed for the scenario reflecting five seasonal campaigns, with the electronic system being less expensive per capita than the hybrid system for all population sizes ($1.93 vs.$1.95 [100,000], $1.91 vs.$1.94 [500,000], $1.87 vs.$1.94 [1,000, 000]). Sensitivity analyses identified factors related to nurse hours as affecting the direction and magnitude of the results.</p> <p>Conclusions</p> <p>Five-year cost projections for electronic systems were comparable or less expensive than for hybrid systems, at all PHU population sizes. An intangible benefit of the electronic system is having data rapidly available for reporting.</p

Assessing Local Risk of Rifampicin-Resistant Tuberculosis in KwaZulu-Natal, South Africa Using Lot Quality Assurance Sampling.

KwaZulu-Natal (KZN) has the highest burden of notified multidrug-resistant tuberculosis (MDR TB) and extensively drug-resistant (XDR) TB cases in South Africa. A better understanding of spatial heterogeneity in the risk of drug-resistance may help to prioritize local responses.Between July 2012 and June 2013, we conducted a two-way Lot Quality Assurance Sampling (LQAS) study to classify the burden of rifampicin (RIF)-resistant TB among incident TB cases notified within the catchment areas of seven laboratories in two northern and one southern district of KZN. Decision rules for classification of areas as having either a high- or low-risk of RIF resistant TB (based on proportion of RIF resistance among all TB cases) were based on consultation with local policy makers.We classified five areas as high-risk and two as low-risk. High-risk areas were identified in both Southern and Northern districts, with the greatest proportion of RIF resistance observed in the northernmost area, the Manguzi community situated on the Mozambique border.Our study revealed heterogeneity in the risk of RIF resistant disease among incident TB cases in KZN. This study demonstrates the potential for LQAS to detect geographic heterogeneity in areas where access to drug susceptibility testing is limited

Electronic immunization data collection systems: application of an evaluation framework

Abstract Background Evaluating the features and performance of health information systems can serve to strengthen the systems themselves as well as to guide other organizations in the process of designing and implementing surveillance tools. We adapted an evaluation framework in order to assess electronic immunization data collection systems, and applied it in two Ontario public health units. Methods The Centers for Disease Control and Prevention’s Guidelines for Evaluating Public Health Surveillance Systems are broad in nature and serve as an organizational tool to guide the development of comprehensive evaluation materials. Based on these Guidelines, and informed by other evaluation resources and input from stakeholders in the public health community, we applied an evaluation framework to two examples of immunization data collection and examined several system attributes: simplicity, flexibility, data quality, timeliness, and acceptability. Data collection approaches included key informant interviews, logic and completeness assessments, client surveys, and on-site observations. Results Both evaluated systems allow high-quality immunization data to be collected, analyzed, and applied in a rapid fashion. However, neither system is currently able to link to other providers’ immunization data or provincial data sources, limiting the comprehensiveness of coverage assessments. We recommended that both organizations explore possibilities for external data linkage and collaborate with other jurisdictions to promote a provincial immunization repository or data sharing platform. Conclusions Electronic systems such as the ones described in this paper allow immunization data to be collected, analyzed, and applied in a rapid fashion, and represent the infostructure required to establish a population-based immunization registry, critical for comprehensively assessing vaccine coverage

Impact of changing relations upon the duration of an obligation

<p>Eligibility and enrollment of TB cases included at sites that enrolled prospectively.</p

Barriers to the use of reminder/recall interventions for immunizations: a systematic review

Abstract Background Although many studies have demonstrated the benefits of reminder/recall (RR) measures to address patient under-immunization and improve immunization coverage, they are not widely implemented by healthcare providers. We identified providers’ perceived barriers to their use from existing literature. Methods We conducted a systematic review of relevant articles published in English between January 1990 and July 2011 that examined the perceptions of healthcare providers regarding barriers to tracking patient immunization history and implementing RR interventions. We searched MEDLINE, PubMed, EMBASE, Cumulative Index to Nursing and Allied Health Literature, Academic Search Premier, and PsychINFO. Additional strategies included hand-searching the references of pertinent articles and related reviews, and searching keywords in Google Scholar and Google. Results Ten articles were included; all described populations in the United States, and examined perceptions of family physicians, pediatricians, and other immunization staff. All articles were of moderate-high methodological quality; the majority (n=7) employed survey methodology. The most frequently described barriers involved the perceived human and financial resources associated with implementing an RR intervention, as well as low confidence in the accuracy of patient immunization records, given the lack of data sharing between multiple immunization providers. Changes to staff workflow, lack of appropriate electronic patient-tracking functionalities, and uncertainty regarding the success of RR interventions were also viewed as barriers to their adoption. Conclusions Although transitioning to electronic immunization records and registries should facilitate the implementation of RR interventions, numerous perceived barriers must still be overcome before the full benefits of these methods can be realized

Operating characteristic curve for a sample size of 82 and decision rule of 4.

<p>The operating characteristic curve demonstrates that a sample size of 82 new TB cases and a decision cut-off of 4 achieves the desired misclassification properties (<10% misclassifications at a true prevalence of resistance of 8% and at a true prevalence of resistance of 2%).</p

LQAS classifications: retrospective sites (n = 403).

<p>LQAS classifications: retrospective sites (n = 403).</p